HAND-HELD COMPUTERS INCORPORATING 
REDUCED AREA IMAGING DEVICES 

This application is a continuation-in-part of U.S. Serial No. 09/638,976 filed on 
5 August 15, 2000, entitled "Hand Held Computers Incorporating Reduced Area Imaging 
Devices", which is a continuation-in-part of U.S. Serial No. 09/496,312, filed February 
1, 2000, and entitled "Reduced Area Imaging Devices", which is a continuation 
application of U.S. Serial No. 09/175,685, filed October 20, 1998 and entitled "Reduced 
Area Imaging Devices", now U.S. Patent No. 6,043,839, which is a continuation-in-part 
10 of U.S. Serial No. 08/944,322, filed October 6, 1997 and entitled "Reduced Area 
Imaging Devices Incorporated Within Surgical Instruments", now U.S. Patent No. 
5,929,901. 

Technical Field 

15 This invention relates to solid state image sensors and associated electronics, and 

more particularly, to solid state image sensors which are configured to be of a minimum 
size and used within miniature computer systems known as palm top computers, 
personal digital assistants (PDA), or hand-held computers/organizers. 

20 Background Art 

The three most common solid state image sensors include charged-coupled 
devices (CCD) charge injection devices (CID) and photo diode arrays. In the mid- 
1980s, complementary metal oxide semiconductors (CMOS) were developed for 
industrial use. CMOS imaging devices offer improved functionality and simplified 

25 system interfacing. Furthermore, many CMOS imagers can be manufactured at a 
fraction of the cost of other solid state imaging technologies. 

The CCD device is still the preferred type of imager used in scientific 
applications. Only recently have CMOS-type devices been improved such that the 
quality of imaging compares to that of CCD devices. However, there are enormous 

30 drawbacks with CCD devices. Two major drawbacks are that CCD devices have 

immense power requirements, and the amount of processing circuitry required for a CCD 
imager always requires the use of a remote processing circuitry module which can 
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process the image signal produced by the CCD imager. Also, because of the type of chip 
architecture used with CCD devices, on-chip processing is impossible. Therefore, even 
timing and control circuitry must be remoted from the CCD imager plane. Therefore, 
CCD technology is the antithesis of "camera on a chip" technology discussed below. 

5 One particular advance in CMOS technology has been in the active pixel-type 

CMOS imagers which consist of randomly accessible pixels with an amplifier at each 
pixel site. One advantage of active pixel-type imagers is that the amplifier placement 
results in lower noise levels. Another major advantage is that these CMOS imagers can 
be mass-produced on standard semiconductor production lines. One particularly notable 

10 advance in the area of CMOS imagers including active pixel-type arrays is the CMOS 

imager described in U.S. Patent No. 5,471,515 to Fossum, et al. This CMOS imager can 
incorporate a number of other different electronic controls that are usually found on 
multiple circuit boards of much larger size. For example, timing circuits, and special 
functions such as zoom and anti-jitter controls can be placed on the same circuit board 

15 containing the CMOS pixel array without significantly increasing the overall size of the 
host circuit board. Furthermore, this particular CMOS imager requires 100 times less 
power than a CCD-type imager does. In short, the CMOS imager disclosed in Fossum, 
et al. has enabled the development of a "camera on a chip." 

Passive pixel-type CMOS imagers have also been improved so that they too can 

20 be used in an imaging device, which qualifies as a "camera on a chip." In short, the 
major difference between passive and active CMOS pixel arrays is that a passive pixel- 
type imager does not perform signal amplification at each pixel site. One example of a 
manufacturer which has developed a passive pixel array with performance nearly equal to 
known active pixel devices and compatible with the read out circuitry disclosed in the 

25 U.S. Patent No. 5,471,5 15 is VLSI Vision, Ltd., 1 190 Saratoga Avenue, Suite 180, San 
Jose, California 95129. A further description of this passive pixel device may be found 
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in the applicant's patent entitled "Reduced Area Imaging Devices Incorporated Within 
Surgical Instruments," now U.S. Patent No. 5,986,693, and is hereby incorporated by 
reference. 

In addition to the active pixel-type CMOS imager which is disclosed in U.S. 
5 Patent No. 5,471,5 15, there have been developments in the industry for other solid state 
imagers which have resulted in the ability to have a "camera on a chip." For example, 
Suni Microsystems, Inc. of Mountain View, California, has developed a CCD/CMOS 
hybrid which combines the high quality image processing of CCDs with standard CMOS 
circuitry construction. In short, Suni Microsystems, Inc. has modified the standard 

10 CMOS and CCD manufacturing processes to create a hybrid process providing CCD 
components with their own substrate which is separate from the P well and N well 
substrates used by the CMOS components. Accordingly, the CCD and CMOS 
components of the hybrid may reside on different regions of the same chip or wafer. 
Additionally, this hybrid is able to run on a low power source (5 volts) which is normally 

15 not possible on standard CCD imagers which require 10 to 30 volt power supplies. A 
brief explanation of this CCD/CMOS hybrid can be found in the article entitled "Startup 
Suni Bets on Integrated Process" found in Electronic News, January 20, 1997 issue. 
This reference is hereby incorporated by reference for purposes of explaining this 
particular type of imaging processor. 

20 Another example of a recent development in solid state imaging is the 

development of a CMOS imaging sensor which is able to achieve analog to digital 
conversion on each of the pixels within the pixel array. This type of improved CMOS 
imager includes transistors at every pixel to provide digital instead of analog output that 
enables the delivery of decoders and sense amplifiers much like standard memory chips. 

25 With this new technology, it may, therefore, be possible to manufacture a true digital 
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"camera on a chip." This CMOS imager has been developed by a Stanford University 
joint project and is headed by Professor Abbas el-Gamal. 

A second approach to creating a CMOS-based digital imaging device includes the 
use of an over-sample converter at each pixel with a one bit comparator placed at the 
5 edge of the pixel array instead of performing all of the analog to digital functions on the 
pixel. This new design technology has been called MOSAD (multiplexed over sample 
analog to digital) conversion. The result of this new process is low power usage, along 
with the capability to achieve enhanced dynamic range, possibly up to 20 bits. This 
process has been developed by Amain Electronics of Simi Valley, California. A brief 
10 description of both of the processes developed by Stanford University and Amain 

Electronics can be found in an article entitled "A/D Conversion Revolution for CMOS 
Sensor?," September 1998 issue of Advanced Imaging, This article is also hereby 
incorporated by reference for purposes of explaining these particular types of imaging 
processors. 

15 Yet another example of a recent development with respect to solid state imaging 

is an imaging device developed by ShellCase, of Jerusalem, Israel. In an article entitled 
"A CSP Optoelectronic Package for Imaging and Light Detection Applications" (A. 
Badihi), ShellCase introduces a die-sized, ultrathin optoelectronic package which is 
completely packaged at the wafer level using semiconductor processing. In short, 

20 ShellCase provides a chip scale package (CSP) process for accepting digital image 

sensors which may be used, for example, in miniature cameras. The die-sized, ultrathin 
package is produced through a wafer level process which utilizes optically clear materials 
and completely encases the imager die. This packaging method, ideally suited for 
optoelectronic devices, results in superior optical performance and form factor not 

25 available by traditional image sensors. This article is also incorporated by reference for 
purposes of explaining ShellCase' s chip scale package process. 
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Yet another example of a recent development with respect to solid state imaging 
is shown in U.S. Patent No. 6,020,581 entitled "Solid State CMOS Imager Using Silicon 
on Insulator or Bulk Silicon." This patent discloses an image sensor incorporating a 
plurality of detector cells arranged in an array wherein each detector cell as a MOSFET 

5 with a floating body and operable as a lateral bipolar transistor to amplify charge 

collected by the floating body. This invention overcomes problems of insufficient charge 
being collected in detector cells formed on silicon on insulator (SOI) substrates due to 
silicon thickness and will also work in bulk silicon embodiments. 

The above-mentioned developments in solid state imaging technology have 

10 shown that "camera on a chip" devices will continue to be enhanced not only in terms of 
the quality of imaging which may be achieved, but also in the specific construction of the 
devices which may be manufactured by new breakthrough processes. 

Although the "camera on a chip" concept is one which has great merit for 
application in many industrial areas, a need still exists for a reduced area imaging device 

15 which can be used in even the smallest type of industrial application. Recently, devices 
known as palm top computers, PDA(s), or hand-held computers have become very 
popular items. Essentially, these PDAs are miniature computers, small enough to be held 
in the hand, which have various software programs available to a user including word 
processing, e-mail, and organization software for addresses/phone books, etc. 

20 One example of a U.S. patent disclosing a type of a PDA includes U.S. Patent 

No. 5,900,875. This patent is incorporated herein by reference for purposes of 
illustrating an example of a PDA including basic functionality for such a device. In a 
recent article entitled "Palm, Inc. Gets Ready for New Hands" appearing in the 
Wallstreet Journal, a number of soon to be commercially available PDAs are disclosed. 

25 One such device disclosed in this article is known as the "Hand Spring Visor Deluxe." 
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This device will soon be available which allows a user to accommodate pagers, MP3 

players, still digital cameras and other devices. 

It is one general object of this invention to provide a video system in combination 

with a standard PDA enabling a user to take video images by a very small camera 
5 module incorporated within the PDA, view the video images taken on a video view 

screen incorporated within the PDA, and to have the capability to store video images, 

download the video images, and send the video images electronically through a 

communications network. 

Another object of this invention is to provide a PDA with the ability to not only 
10 transmit video images taken by the camera module, but also to receive video images sent 

from a remote location via the communications network, and to view such received 

video images on the video view screen of the PDA. Accordingly, the invention is ideally 

suited for video teleconferencing. 

It is another object of this invention to provide a reduced area imaging device 
15 incorporated within a PDA which takes advantage of "camera on a chip" technology, but 

to rearrange the video processing circuitry in a selective stacked relationship so that the 

camera module has a minimum profile. 

It is yet another object of this invention to provide imaging capability for a PDA 

wherein the video camera used is of such small size that it can be stored in the PDA 
20 when not in use. The camera module is attached to the PDA by a retractable cord which 

enables the imaging device to be used to image anything at which the camera module is 

pointed by the user without having to also move the PDA away from the view of the 

user. 

It is yet another object of the invention to provide a video camera with a PDA 
25 wherein the camera communicates with a PDA by a wireless link such as a RF radio link 
so that the camera does not have to be physically connected to the PDA, This wireless 
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connection further enhances the capability to use the camera to shoot video without 
having to move the PDA or otherwise manipulate the PDA in a manner which detracts 
from shooting the video. 

In all applications, to include use of the imaging device of this invention with a 
5 PDA, "camera on a chip" technology can be improved with respect to reducing its 
profile area, and incorporating such a reduced area imaging device within a PDA such 
that minimal size and weight is added to the PDA, and further that the imaging device 
can be used to image selected targets by the user. 
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Disclosure of the Invention 

In accordance with the present invention, reduced area imaging devices are 
provided in combination with a hand-held computer or PDA. The term "imaging device" 
as used herein describes the imaging elements and processing circuitry which is used to 
5 produce a video signal which may be accepted by both a standard video device such as a 
television or video monitor accompanying a personal computer, and a small LCD screen 
which is incorporated within the PDA. The term "image sensor" as used herein 
describes the components of a solid state imaging device which captures images and 
stores them within the structure of each of the pixels in the array of pixels found in the 

10 imaging device. As further discussed below, the timing and control circuits can be 
placed either on the same planar structure as the pixel array, in which case the image 
sensor can also be defined as an integrated circuit, or the timing and control circuitry can 
be placed remote from the pixel array. The terms "video signal" or "image signal 11 as 
used herein, and unless otherwise more specifically defined, refer to an image which at 

15 some point during its processing by the imaging device, is found in the form of electrons 
which have been placed in a specific format or domain. The term "processing circuitry" 
as used herein refers to the electronic components within the imaging device which 
receive the image signal from the image sensor and ultimately place the image signal in a 
usable format. The terms "timing and control circuits" or "timing and control circuitry" 

20 as used herein refer to the electronic components which control the release of the image 
signal from the pixel array. 

In a first embodiment of the PDA, the imaging device connects to the PDA by a 
cable or cord that may retract within the housing of the PDA. Thus in this embodiment, 
the camera is tethered to the PDA. In a second embodiment, the imaging device does 

25 not have to be physically connected to the PDA; rather, a wireless RF link or other 
acceptable wireless technology is used so that video signals produced by the imaging 
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device may be transmitted to and received by the PDA, One particularly advantageous 
wireless technology usable with the PDA of this invention is known as "Bluetooth". 
Another recent wireless technology which is usable with the invention is a wireless 
protocol known as "IEEE 802. 15.3". This wireless standard is developing under the 
5 joint efforts of Kodak, Motorola, Cisco and the International Electronic and Electrical 
Engineers Standards Association (IEEE) Wireless Personal Area Network Working 
Group (WPAN). Bluetooth technology provides a universal radio interface in the 
2.4GHz frequency band that enables portable electronic devices to connect and 
communicate wirelessly via short-range ad hoc networks. Bluetooth radios operate in an 

10 unlicensed Instrumentation, Scientific, Medical (ISM) band at 2.4GHz. Bluetooth is a 
combination of circuit and packet switching. Slots can be reserved for synchronous 
packets. Each packet is transmitted in a different hop frequency. A packet nominally 
covers a single slot, but can be extended to cover up to five slots. Bluetooth can support 
an asynchronous data channel, up to three simultaneous synchronous voice channels, or 

15 a channel that simultaneously supports asynchronous data and synchronous voice. 

Spectrum spreading is used to facilitate optional operation at power levels up to lOOmW 
worldwide. Spectrum spreading is accomplished by frequency hopping in 79 hops 
displaced by 1 MHz, starting at 2.402 GHz and stopping at 2.480GHz. The maximum 
frequency-hopping rate is 1600 hops per second. The nominal link range is 10 

20 centimeters to 10 meters, but can be extended to more than 100 meters by increasing the 
transmit power. A shaped, binary FM modulation is applied to minimize transceiver 
complexity. The gross data rate is IMb/second, A time division duplex scheme is used 
for full-duplex transmission. Additional technical information describing the Bluetooth 
global specification is found on the world wide web at ww»bluetoothxom . Additional 

25 information regarding the technical specification for the IEEE 802. 15.3 standard may be 
found at http://www. ieee802.org/15, under the link for Task Force Three (TG3). 
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Li a first arrangement of the imaging device, the image sensor, with or without 
the timing and control circuitry, may be placed at the distal tip of a very small video 
camera module which communicates with the PDA by a wireless RF link, or is attached 
by a cable or cord to the PDA, or the camera module communicates with the PDA by a 
5 wireless RF link while the remaining processing circuitry may be placed within the 
housing of the PDA. 

In a second arrangement of the imaging device, the image sensor and the 
processing circuitry may all be placed in a stacked arrangement of miniature circuit 
boards and positioned at the distal tip of the video camera module. In this second 

10 arrangement, the pixel array of the image sensor may be placed by itself on its own 

circuit board while the timing and control circuitry and processing circuitry are placed on 
one or more other circuit boards, or the circuitry for timing and control may be placed 
with the pixel array on one circuit board, while the remaining processing circuitry can be 
placed on one or more of the other circuit boards. 

15 In yet another alternative arrangement of the imaging device, the pixel array, 

timing and control circuits, and some of the processing circuitry can be placed near the 
distal end of the video camera module with the remaining part of the processing circuitry 
being placed in the housing of the PDA. 

For the arrangement or configuration of the imaging device that calls for the array of 
20 pixels and the timing and control circuitry to be placed on the same circuit board, only 
one conductor is required in order to transmit the image signal to the video processing 
circuitry. When the timing and control circuits are incorporated onto other circuit 
boards, a plurality of connections are required in order to connect the timing and control 
circuitry to the pixel array, and then the one conductor is also required to transmit the 
25 image signal back to the video processing circuitry. 
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As mentioned above, the invention disclosed herein can be considered an 
improvement to a PDA wherein the improvement comprises a video system. The video 
system would include the video view screen or monitor attached to the PDA, the camera 
module, as well as supporting video processing circuitry for the imaging device. In yet 
5 another aspect, the invention disclosed herein can also be considered an improvement to 
a PDA wherein the improvement comprises a novel imaging device, preferably of CMOS 
construction. For this improvement comprising the imaging device, the imaging device 
includes the array of pixels, and the supporting video processing circuitry for providing a 
video ready signal. 

10 In yet another aspect, the invention disclosed herein can also be considered an 

improvement to a PDA wherein the improvement comprises an imaging device which 
utilizes a wireless standard in order to transmit video images to the PDA. 

This video ready signal may be formatted by the video processing circuitry for 
viewing on a NTSC/PAL compatible device such as television, or for viewing on a VGA 

1 5 compatible device such as a monitor of a personal computer. Of course, the video ready 
signal is formatted for viewing the video images on the video view screen incorporated 
within the PDA. 

In yet another aspect, the invention disclosed herein can also be considered an 
improvement to a PDA wherein the improvement comprises a combination of a video 

20 system, and wireless telephone communication means for transmitting and receiving both 
audio and video signals. In this aspect, the invention has functionality for transmitting 
and receiving audio and video signals via the communications network. One example of 
a U.S. patent disclosing wireless remote communications between a personal computer 
and a PDA or miniature hand held computer is U.S. Patent No. 6,034,621. This patent 

25 is hereby incorporated by reference in its entirety for purposes of disclosing means by 
which data can be exchanged between the hand held computer and a personal computer, 
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to include video and audio signals. The specific example in this patent which readily 
lends itself to the communication network incorporated within this invention is found at 
Figure 4 of this '621 patent. The discussion further below outlines this particular 
communication network. 
5 In yet another aspect, the invention disclosed herein can also be considered an 

improvement to a PDA wherein the improvement comprises a video system, and a 
standard wireless telephone communication means for transmitting and receiving audio 
signals. In this aspect, the PDA simply includes a standard wireless/cellular phone 
connected externally on the PDA which enables the user to conduct well-known 

10 wireless/ telephone communications. This wireless/cellular communication means can be 
in addition to the wireless telephone communication means for transmitting and receiving 
both audio and video signals discussed immediately above with respect to the U.S. 
Patent No. 6,034,621. 

Another example of a U.S. patent disclosing basic mobile phone technology 

15 including a discussion of basic phone circuitry is U.S. Patent No. 6,018,670. This patent 
is hereby incorporated by reference in its entirety for purposes of disclosing standard or 
basic mobile phone technology and supporting circuitry. 

Accordingly, the invention disclosed herein has utility with respect to an overall 
combination of elements, as well as various sub-combinations of elements. 

20 

Brief Description of the Drawing s 

Figure 1 is an enlarged fragmentary partially exploded perspective view of the 
distal end of the camera module which is used in conjunction with the PDA, specifically 
illustrating the arrangement of the image sensor with respect to the other elements of the 
25 camera module; 
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Figure la is an enlarged exploded perspective view illustrating another 
configuration of the image sensor wherein video processing circuitry is placed behind 
and in longitudinal alignment with the image sensor; 

Figure 2 is a perspective view of the PDA in a first embodiment incorporating the 
5 reduced area imaging device of this invention; 

Figure 3 illustrates the PDA of Figure 2 wherein the camera module is in the 
retracted position; 

Figure 4 is an overall schematic diagram of the functional electronic components 
in the first embodiment which make up both the PDA and the reduced area imaging 
10 device wherein communications are achieved by wireless/cellular technology for video 
teleconferencing via the world wide web which is well-known as a global 
communications network; 

Figure 5 is a schematic diagram illustrating an example communications network 
which can be used for data transfer of text, audio, and visual signals between the PDA 
15 and a personal computer which is in communication with the world wide web; 

Figure 6a is a perspective view of the PDA in the first embodiment illustrated in 
combination with an externally attached wireless/cellular phone; 

Figure 6b is another perspective view of the combination of Figure 6a illustrating 
the combination opened to expose the PDA; 
20 Figure 7 is a perspective view of the PDA in a second embodiment wherein the 

camera module utilizes a wireless technology, thus the camera module may be physically 
separated from the PDA during operation, but can still be housed within the PDA for 
storage and for recharge of the battery of the camera module; 

Figure 8 is an overall schematic diagram, similar to Figure 4, of the functional 
25 components which make up the PDA and a simplified cross sectional view of the camera 
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module in the second preferred embodiment wherein the camera module communicates 
with the PDA via a wireless link; 

Figure 8a is an enlarged view of some of the components of the camera module, 
specifically, the components used in the wireless link with the PDA; 
5 Figure 9 is a more detailed schematic diagram of the functional electronic 

components, which make up the imaging device; 

Figure 9a is an enlarged schematic diagram of a circuit board/planar structure, 
which may include the array of pixels and the timing and control circuitry; 

Figure 9b is an enlarged schematic diagram of a video processing board/planar 
10 structure having placed thereon the processing circuitry which processes the pre-video 
signal generated by the array of pixels and which converts the pre-video signal to a post- 
video signal which may be accepted by an NTSC/PAL compatible video device; and 

Figures 10a- lOe are schematic diagrams that illustrate an example of specific 
circuitry which may be used to make the video processing circuitry of the imaging 
15 device. 



Best Mode for Carrying Out the Invention 

In accordance with the invention, as shown in Figure 1, a camera module 10 is 
provided which incorporates a reduced area imaging device 1 1. As further discussed 

20 below, the elements of the imaging device 1 1 may all be found near one location, or the 
elements may be separated from one another and interconnected by the appropriate 
wired connections. The array of pixels making up the image sensor captures images and 
stores them in the form of electrical energy by conversion of light photons to electrons. 
This conversion takes place by the photo diodes in each pixel which communicate with 

25 one or more capacitors which store the electrons. Specifically, the camera module 10 
includes an outer tube/sheath 14 which houses the components of the imaging device. 



15 



The camera module is shown as being cylindrical in shape having a window 16 sealed at 
the distal end of the camera module. A retractable cable 12 extends from the proximal 
end of the camera module 10. A shielded cable 21 is used to house the conductors 
which communicate with the imaging device 11. The shielded cable 21 is then housed 
5 within the retractable cable 12. A lens group 18 is positioned at the distal end of the 
camera module to enable an image to be appropriately conditioned prior to the image 
impinging upon the imaging device 11. Also shown is a focusing ring 20 which enables 
the lens group 18 to be displaced distally or proximally to best focus an image on the 
imaging device 11. 

10 Now referring to Figures 2 and 3, a PDA 22 in a first embodiment is shown 

which incorporates the camera module 10. In basic terms, the PDA 22 is a miniature 
hand-held computer incorporating a video system enabling video to be taken by the 
camera module, and viewed on the video view screen 26, as well as enabling images to 
be stored and downloaded on a miniature computer disc (not shown) used with the PDA. 

15 Also discussed further below is the ability to transmit and receive audio and video 
signals. 

Beginning first with a description of the basic components of the PDA 22, it 
includes a housing 24 which hold the components of the PDA and the video system. 
Cable 12 is housed within the housing 24 when in the retracted position. A spring biased 

20 spool (not shown) or some other known retracting device is mounted within the housing 
24 enabling the cable 12 to be extended or retracted. A plurality of controls is provided 
enabling the user to manipulate the functions of the PDA. These are shown as buttons 
34 on the housing 24. The video view screen 26 is used for displaying video images 
taken by the camera module 10, or for viewing incoming video signals received from a 

25 remote location. A command screen 28 is provided which allows a user to select 

programs with a stylus (not shown). A video capture button 30 is provided which allows 
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a user to capture a still video image taken by the camera module 10. A video store 
button 32 is also provided which enables a captured video image to be stored within the 
digital memory of the PDA, as further discussed below. An opening or cavity 35 is 
provided which allows the camera module 10 to be stored, along with cable 12 within 
5 the housing 24. As shown in Figure 3, the camera module 10 is in the stored or retracted 
position. The antenna 36 allows for enhanced transmission and reception of incoming or 
transmitted/outgoing audio and video signals. A video select switch 37 is provided 
enabling a user to view either video images taken by the camera module 10, or for 
viewing incoming video images. The video view screen 26 may be a liquid crystal 

10 display (LCD) type, or any other well-known display device of high resolution which has 
low power requirements, and has minimum size requirements as well. 

An example of a manufacture of such a miniature LCD monitor includes 
DISPLAYTECH of Longmont, Colorado. DISPLAYTECH manufactures a miniature 
reflective display that consists of ferroelectric liquid crystal (FLC) applied to a CMOS 

1 5 integrated circuit. The reflective display is a VGA display panel having low voltage 

digital operation, low power requirements, and full color operation. One of their specific 
products includes the LightCaster ™ VGA Display Panel, Model LDP-0307-MV1 . This 
is but one example of a LCD monitor that is available and usable within the invention 
herein described. 

20 A camera on/off switch 66 is provided enabling the user to turn the video system 

on or off. Also shown in Figures 2 and 3 is a speaker 76 and a microphone 78 which 
are used for sending and receiving audio signals in the conventional manner as with a 
wireless/cellular telephone. A further description of speaker 76 and microphone 78 is 
found below. 

25 Referring back to Figures 1 and la, the imaging device 1 1 includes an image 

sensor 40. Figure 1 illustrates that the image sensor 40 can be a planar and square 
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shaped member, or alternatively, planar and circular shaped to better fit within outer tube 
14. In the configuration of the imaging device in Figures 1 and la, there are only three 
conductors which are necessary for providing power to the image sensor 40, and for 
transmitting an image from the image sensor 40 back to the processing circuitry found 
5 within the phone housing 24. Specifically, there is a power conductor 44, a grounding 
conductor 46, and an image signal conductor 48, each of which are hardwired to the 
image sensor 40. Thus, shielded cable 21 may simply be a three conductor, 50 ohm type 
cable. 

Image sensor 40 can be as small as 1 mm in its largest dimension. However, a 

10 more preferable size for most PDA applications would be between 4 mm to 8 mm in the 
image sensor's largest dimension (height or width). The image signal transmitted from 
the image sensor 40 through conductor 48 is also herein referred to as a pre-video signal. 
Once the pre-video signal has been transmitted from image sensor 40 by means of 
conductor 48, it is received by video processing board 50, as shown in Figure 6b. Video 

1 5 processing board 50 then carries out all the necessary conditioning of the pre-video 
signal and places it in a form, also referred to herein as a video ready signal, so that it 
may be viewed directly on a remote video device such as a television or standard 
computer video monitor. In order for the pre-video signal to be viewed on the video 
view screen/monitor 26, the pre-video signal is further conditioned by a digital signal 

20 processor 72, as further discussed below. The video signal produced by the video 

processing board 50 can be viewed by an NTSC/PAL compatible video device (such as a 
television) which connects to the PDA through a remote jack. This video signal 
produced by board 50 can be further defined as a post-video signal. 

Figure 1 illustrates an arrangement wherein the image sensor 40 is placed by itself 

25 adjacent the distal end of the camera module 10. Alternatively, some or all of the video 
processing circuitry may be placed in adjacent circuit boards directly behind the image 
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sensor 40. Accordingly, la illustrates video processor board 50 aligned directly behind 
the image sensor 40. A plurality of pin connectors 52 can be used to interconnect image 
sensor 40 to video processor board 50. Depending upon the specific configuration of 
image sensor 40, pin connectors 52 may be provided for structural support only, and/or 
5 to provide a means by which image signals are transmitted between image sensor 40 and 
board 50. Additionally, digital signal processor 72 could also be placed behind image 
sensor 40 and behind video processing board 50. Accordingly, the image sensor, and all 
supporting video processing circuitry could be placed at the distal end of the camera 
module 10. However, because of the ample space within housing 24, it may be 

10 preferable to place at least some of the video processing circuitry within housing 24. In 
the case of Figure la, the conductor 49 represents the conductor which may carry the 
post-video signal for direct connection with a remote video device 60 such as a television 
or computer monitor. As also discussed further below with respect to the first 
embodiment, placement of the digital signal processor 72 at the distal tip of the camera 

15 module behind the video processing board 50 would also enable yet another conductor 
(not shown) to connect directly to the video monitor 26 for transmitting a video signal to 
the video monitor 26. 

Again referring to Figures 1 and la, the area which is occupied by image sensor 
40 may be defined as the profile area of the imaging device and which determines its 

20 critical dimensions. If it is desired to place video processing circuitry adjacent the image 
sensor 40 at the distal end of the camera module 10, such circuitry must be able to be 
placed on one or more circuit boards that are longitudinally aligned with image sensor 40 
along longitudinal axis XX. If it is not important to limit the size of the profile area, then 
any circuitry placed behind image sensor 40 can be aligned in an offset manner, or may 

25 simply be larger than the profile area of image sensor 40. In the configuration shown in 
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Figure la, it is desirable that elements 40 and 50 be approximately the same size so that 
they may uniformly fit within the distal end of outer tube 14. 

Now referring to the first embodiment of Figure 4, a further explanation is 
provided of the basic electronic components of the PDA 22. The PDA 22 of this 
5 invention includes functionality normally found in multiple devices. Specifically, the 
PDA 22 includes the computing capability of a PDA, a mobile/wireless phone, 
communication means for connection to a computer network such as the worldwide 
web, and a video system. The PDA 22 may be separated into two major groups, namely, 
a video and communication system 61, and a computer processing and memory unit 82. 

10 Both of these are discussed in further detail below. 

As shown in Figure 4, a conventional lithium ion battery 62 is provided which 
communicates with power supply board 64. Power supply board 64 conditions various 
power outputs to the components of the device, to include power to the video 
components. In the preferred imaging device of this invention, the power to the imaging 

15 device may simply be direct current of between about 1.5 to 12 volts, depending upon 
the power requirements of the imaging device. A camera on/off switch 66 must be set to 
the "on" position in order to activate the camera module 10. The video processor board 
50 then transfers power to supplies the camera module 10, and also receives the analog 
pre-video signal back from the camera module, as further discussed below. After 

20 processing of the pre-video signal at the video processor board 50, the video signal is 
video ready, meaning that it may then be directly viewed on a remote compatible video 
device 60, such as a television or computer monitor. A video port 54 can be provided 
on the housing 24 enabling a user to take a standard video jack (not shown) and 
interconnect the PDA with the video port of the remote video device. The video format 

25 for such remote video devices includes NTSC/PAL and VGA; thus, the video signal 

processed by video processor board 50 creates the video ready signals for use with these 
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remote video devices. For purposes of viewing images on the monitor 26, the pre-video 
signal is further processed into a digital format within video processor board 50, 
preferably an 8 bit component video signal format that is commonly referred to as "YUV 
4:2:2/' This video format easily lends itself to video compression. This 8-bit digital 
5 video signal is then sent to the digital signal processor 72 which performs two functions 
relevant to the video signal. The digital signal processor 72 further converts the signal 
into a format that is compatible with the driver circuitry of the video monitor 26. 
Secondly, the digital signal processor 72 compresses the YUV signal using a common 
video compression format, preferably JPEG. The JPEG encoded video signal is then 

10 mixed with the audio signal created by microphone 78 and amplifier 74, and the resulting 
high frequency carrier signal may then be passed onto the transceiver/amplifier section 70 
for transmission. It is to be understood that the transceiver/amplifier 70 is intended for 
communication with well-known wide area wireless communication networks. It is also 
contemplated within the spirit and scope of this invention that the PDA 22 be capable of 

1 5 communication with computer networks to include the worldwide web. Accordingly, 
the invention is well adapted for conducting video teleconferencing that is normally 
conducted with desktop computers and supplemental video equipment. The 
transceiver/amplifier section also modulates the carrier signal prior to transmission. 
Depending upon the position of video switch 37, the video signal from digital signal 

20 processor 72 is either sent to the monitor 26, or is sent to the transceiver/amplifier 

section 70 for transmission. As also shown, the antenna 36 is used for enhancement of 
reception and transmission of transmitted and received carrier signals. 

The transceiver/amplifier section 70 also serves as a receiver that receives an 
incoming carrier signal. This incoming signal is then demodulated within section 70, the 

25 video and audio components of the incoming signal are separated, and then these 

separated signals are then sent to the digital signal processor 72 which performs video 
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decompression. Then, the decompressed video signal is sent to the monitor 26 for 
viewing (if the video switch 37 is placed in that selected mode). The decompressed 
audio signal is sent to the amplifier 74, and then to the speaker 76. 

Figure 4 shows the transceiver/amplifier section 70 as being a cellular digital 
5 packet data system (CDPD) type transceiver. This particular transceiver/amplifier 70 
could be the same as that disclosed in the U.S. Patent No. 6,034,621. A cellular digital 
packet system is a wireless standard providing two-way, 19.2 KBPS packet data 
transmission over existing cellular telephone channels. 

The video switch 37 may simply be a momentary, spring loaded, push button- 

10 type switch. When the video switch 37 is not depressed, incoming video, which is 

received via the antenna 36, is processed as discussed above in the transceiver/amplifier 
section 70 and digital signal processor 72, and then sent to the monitor 26. When the 
video switch 37 is depressed and held, the video signal produced from the camera 
module 10 is processed as discussed above, and ultimately sent to the monitor 26 for 

15 viewing by the user. An operator can cycle the switch 37 between the two positions in 
order to selectively choose whether to view incoming or outgoing video. 

Figure 5 illustrates a communications network that can be used by the invention. 
A communications network of this type is disclosed in the U.S. Patent No. 6,034,621, 
and is discussed specifically therein at Figures 3 and 4 of that patent. Figure 5 illustrates 

20 a CDPD base station 182 with a remote computer 188 utilizing a direct connection to the 
CDPD base station 182 via a modem 186 with a dial-up connection to the public switch 
telephone network (PSTN) 184. The CDPD base station 182 includes an antenna 181. 
The remote computer 188 can be a personal computer, a server, or any other well- 
known stand-alone computer. 

25 Referring back to Figure 4, the computer processing and memory unit 82 which 

allows the PDA 22 to achieve basic word processing, etc., includes a microprocessor 83, 
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RAM 84, ROM 86, and digital storage 88. Digital storage 88 is provided for storing the 
formatted images taken by the camera module 10. The RAM 84, microprocessor 83, 
and ROM 86 are conventional or standard components as found in existing PDAs. An 
input/output bus 89 is provided which allows video signals to be stored or otherwise 

5 manipulated within the computer processing and memory unit 82. Accordingly, video 
taken by camera module 10 can be downloaded to digital storage 88. Also, existing 
image data stored in digital storage 88 could be viewed on video monitor 26. 

Figures 6a and 6b illustrate another combination of the invention wherein the 
PDA 22 is simply combined with an externally mounted cellular telephone 190. The 

10 cellular phone 190 is a commercially available cellular/wireless telephone. As shown, the 
telephone includes the standard keypad 194, visual display 196, and antennae 198. The 
phone 190 is secured to the PDA 22 as by mounting means 192, which is shown in the 
preferred embodiment as a piano-type hinge. Thus, the PDA is altered very simply by 
providing means by which a cellular telephone can be attached to the PDA. This enables 

1 5 the user to hold both the PDA and cellular telephone in one hand while manipulating the 
PDA or phone 190 as desired with the other hand. All of the telephone circuitry for 
phone 190 is housed within the phone itself, and there is no circuitry within the PDA 
which is used within the phone 190. 

The actual size of the phone 190 is smaller than the PDA 22. However, in order 

20 to create a uniform edged combination, the phone 190 is housed in a larger housing 200 
which essentially matches the dimensions of housing 24. Additionally, a peripheral 
flange could be provided on the inner surface of housing 200 which comes into contact 
with housing 24 in the closed position of Figure 6a which would prevent inadvertent 
activation of the control buttons on the PDA 22. 

25 Now referring to Figures 7 and 8, the second embodiment of the PDA is 

illustrated that utilizes a wireless camera module 10'. As with the first embodiment, the 
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camera module 10' is cylindrical shaped and can be stored within hole or orifice 35. 
Thus, exteriorly, the PDA 22 appears the same, along with camera module 10' with the 
exception that there is no cable or cord interconnecting the camera module 10' to the 
PDA device 22. Now also referring to Figures 8 and 8a, in lieu of a wired connection, 
5 the camera module 10'communicates with the PDA 22 by a transceiver radio element 91 
which is mounted in the proximal end of the module 10'. Similarly, the PDA 22 also 
includes its own transceiver radio module 85 which allows video signals transmitted by 
transceiver 91 to be received and then passed on to the video processor board 50 for 
further video signal processing, as necessary. Antennae 93 communicates with 

10 transceiver module 85 for enhancing reception of incoming video signals from the 
camera module 10'. The camera module 10' also has its own antennae 81 which 
enhances reception for authenticating signals which may be transmitted by transceiver 
91 . As understood by those skilled in the art, Bluetooth and other RF standards involve 
two-way communications whereby transmissions are authenticated and synchronized. 

15 Thus the transceiver module 85 whose main function is to receive a signal from the 

camera module 10', also transmits some signals to the camera module 10'. Accordingly, 
the camera module also acts as a receiver to authenticate and receive such signals. The 
proximal end of the camera module 10'also includes a rechargeable battery 79 which is 
recharged when the module 10' is seated within the opening 35 of the PDA 22. The 

20 battery 79 can be a common rechargeable nickel-cadmium or lithium-ion type battery. 
The battery 79 has a contact 77 protruding from the proximal tip of the camera module 
10'. The deepest portion of chamber/opening 35 also has a contact 87 (shown 
schematically in Figure 8) which makes contact with contact 77 when the camera module 
10' is placed in the chamber. Contact 87 electrically couples with camera battery 

25 charging circuit 95 which provides an electrical charge for recharging the battery 79. 

When the camera module 10' is placed in the chamber 35, the external housing or casing 
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of the camera module 10' is electrically conductive and contacts a ground (not shown) 
such as spring loaded clip within the chamber 35. Thus, recharge of the battery 79 can 
be accomplished. 

As shown in Figure 8, the charge circuit 95 receives power from power supply 
5 board 64. Thus, the battery 62 of the PDA also provides recharging capability to the 
battery 79. 

The operation of the PDA is essentially the same in the second embodiment. If 
the user desires to transmit video images to another party, the user would grasp the 
camera module 10', remove it from chamber 35, and then point it at the target. The 

10 camera module 10' collects the video images through the objective lens group 18 which 
conditions images received by the image sensor 40. The plurality of conductors housed 
in the shielded miniature cable 21 transfers the video signals to the transceiver radio 
element 91. The transceiver radio element 91, among other functions, adds a high 
frequency carrier signal and base band protocol to the video signal which is then 

15 transmitted to the transceiver radio module 85. The video signal transmitted by the 
transceiver radio element 91 is authenticated by the transceiver radio module 85, the 
video signal is stripped of its carrier, and then routed by a link controller (not shown as a 
separate element apart from transceiver 85) to the video processor circuitry 50. The 
video signal is then handled in the same manner as the first embodiment. The user would 

20 depress the video switch 37 to initiate transmission of the video to the other party of the 
telephone call. Once the camera module 10' is removed from its seated position in the 
chamber 35, the contact between contacts 77 and 87 is broken. This break in electrical 
contact would allow the battery 79 to energize the camera module 10', and thus allow 
the camera module 10' to begin wirelessly communicating with the transceiver radio 

25 module 85 . The user would be able to easily hold and point the camera module 10' 
with one hand, while operating the PDA 22 in the other hand. As with the first 
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embodiment, the video monitor 26 would display the video images simultaneously while 
video images were being transmitted to the other party so long as video switch 37 was 
depressed. If the user wished to receive video images transmitted from the other party, 
the user would simply reset the video switch 37 to its off or inactive state. The camera 
5 module 10' would continue to shoot video and communicate with the module 85; 
however, the video images would not be seen on screen 26. Again as with the first 
embodiment, a remote video device 60 could receive video images and remotely display 
and record the same. 

Although Figure 8 illustrates the video processor board 50 located within the 
10 PDA 22, the video processor board 50 may alternatively be co-located with the imaging 
device 40 within the distal tip of the camera module 10'. Accordingly, all necessary 
video processing may take place within the camera module and the video signal which 
would be transmitted by the radio transceiver element 91 is a post video signal which is 
ready for viewing by either the video monitor 26, or the remote video device 60 once the 
15 transceiver radio module 85 receives, authenticates, and strips the video signal of its 
carrier frequency as transmitted by the radio transceiver element 91. 

Figure 9 is a schematic diagram illustrating one way in which the imaging device 
1 1 may be constructed. As illustrated, the image sensor 40 may include the timing and 
control circuits on the same planar structure. Power is supplied to image sensor 40 by 
20 power supply board 64. The connection between image sensor 40 and board 64 may 
simply be a cable having two conductors therein, one for ground and another for 
transmitting the desired voltage. These are illustrated as conductors 44 and 46. The 
output from image sensor 40 in the form of the pre-video signal is input to video 
processor board 50 by means of the conductor 48. In the configuration of Figure 7, 
25 conductor 48 may simply be a 50-ohm conductor. Power and ground also are supplied 
to video processing board 50 by conductors 44 and 46 from power supply board 52. 
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The output signal from the video processor board 50 is in the form of the post-video 
signal and which may be carried by conductor 49 which can also be a 50 ohm conductor. 
As discussed above with respect to the second embodiment, in lieu of a hard wired 
connection by conductors 48 and 49, the pre-video or post-video signal is transmitted 

5 wirelessly to the transceiver radio module 85. 

Although Figure 9 illustrates the image sensor and the timing and control circuits 
being placed on the same circuit board or planar structure, it is possible to separate the 
timing and control circuits from the pixel array and place the timing and control circuits 
onto video processing board 50. The advantage in placing the timing and control circuits 

10 on the same planar structure as the image sensor is that only three connections are 
required between image sensor 40 and the rest of the imaging device, namely, 
conductors 44, 46 and 48. Additionally, placing the timing and control circuits on the 
same planar structure with the pixel array results in the pre-video signal having less 
noise. Furthermore, the addition of the timing and control circuits to the same planar 

15 structure carrying the image sensor only adds a negligible amount of size to one 

dimension of the planar structure. If the pixel array is to be the only element on the 
planar structure, then additional connections must be made between the planar structure 
and the video processing board 50 in order to transmit the clock signals and other 
control signals to the pixel array. For example, a ribbon-type cable (not shown) or a 

20 plurality of 50-ohm coaxial cables (not shown) must be used in order to control the 

downloading of information from the pixel array. Each of these additional connections 
would be hard wired between the boards. 

Figure 9a is a more detailed schematic diagram of image sensor 40 which 
contains an array of pixels 90 and the timing and control circuits 92. One example of a 

25 pixel array 90 which can be used within the invention is similar to that which is disclosed 
in U.S. Patent No. 5,471,515 to Fossum, et al., said patent being incorporated by 
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reference herein. More specifically, Figure 3 of Fossum, et al. illustrates the circuitry 
that makes up each pixel in the array of pixels 90. The array of pixels 90 as described in 
Fossum, et al. is an active pixel group with intra-pixel charged transfer. The image 
sensor made by the array of pixels is formed as a monolithic complementary metal oxide 

5 semiconductor (CMOS) integrated circuit which may be manufactured in an industry 
standard complementary metal oxide semiconductor process. The integrated circuit 
includes a focal plane array of pixel cells, each one of the cells including a photo gate 
overlying the substrate for accumulating the photo generated charges. In broader terms, 
as well understood by those skilled in the art, an image impinges upon the array of pixels, 

10 the image being in the form of photons which strike the photo diodes in the array of 
pixels. The photo diodes or photo detectors convert the photons into electrical energy 
or electrons which are stored in capacitors found in each pixel circuit. Each pixel circuit 
has its own amplifier which is controlled by the timing and control circuitry discussed 
below. The information or electrons stored in the capacitors is unloaded in the desired 

15 sequence and at a desired frequency, and then sent to the video processing board 50 for 
further processing. 

Although the active pixel array disclosed in U.S. Patent No. 5,471,515 is 
mentioned herein, it will be understood that the hybrid CCD/CMOS described above, or 
any other solid state imaging device may be used wherein timing and control circuits can 

20 be placed either on the same circuit board or planar structure with the pixel array, or may 
be separated and placed remotely. Furthermore, it will be clearly understood that the 
invention claimed herein is not specifically limited to an image sensor as disclosed in the 
U.S. Patent No. 5,471,515, but encompasses any image sensor which may be configured 
for use in conjunction with the other processing circuitry which makes up the imaging 

25 device of this invention. 
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To summarize the different options available in terms of arrangement of the 
components of the imaging device 1 1, the array of pixels 90 of the image sensor 40 may 
be placed alone on a first plane, or the timing and control circuitry 92 may be placed with 
the array of pixels 90 on the first plane. If the timing and control circuitry 92 is not 

5 placed with the array of pixels 90 on the first plane, the timing and control circuitry 92 
may be placed by itself on a second plane, or the timing and control circuitry 92 may be 
placed on a second plane with some or all of the processing circuitry from video 
processing board 50. The video processing board 50 itself may be placed on one or 
more planes on corresponding circuit boards containing video processing circuitry. 

10 Figure la illustrates a single video processor board 50 located directly behind image 
sensor 40; however, it shall be understood that additional circuit boards containing 
additional circuitry may be placed behind the image sensor 40 and behind the video 
processing board 50. Some or all of the video processing circuitry may be placed within 
the camera module 10 near the distal end thereof adjacent the image sensor 40. Video 

15 processing circuitry which is not placed within the distal end of the camera module 10 
may be placed within the housing 24 of the PDA. If video processing circuitry is placed 
near the distal end of the camera module 10, it is preferable to arrange the video 
processing circuitry in a stacked relationship behind the image sensor 40. Additionally, it 
is preferable to place the processing circuitry in a parallel arrangement with respect to 

20 image sensor 40 and to center such video processing circuitry along axis X-X in order to 
minimize the size of camera module 10. 

The timing and control circuits 92 are used to control the release of the image 
information or image signal stored in the pixel array. In the image sensor of Fossum, et 
al., the pixels are arranged in a plurality of rows and columns. The image information 

25 from each of the pixels is first consolidated in a row by row fashion, and is then 

downloaded from one or more columns that contain the consolidated information from 
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the rows. As shown in Figure 9a, the control of information consolidated from the rows 
is achieved by latches 94, counter 96, and decoder 98. The operation of the latches, 
counter and decoder is similar to the operation of similar control circuitry found in other 
imaging devices. That is, a latch is a means of controlling the flow of electrons from 

5 each individual addressed pixel in the array of pixels. When a latch 94 is enabled, it will 
allow the transfer of electrons to the decoder 98. The counter 96 is programmed to 
count a discrete amount of information based upon a clock input from the timing and 
control circuits 92. When the counter 96 has reached its set point or overflows, the 
image information is allowed to pass through the latches 94 and be sent to the decoder 

10 98 which places the consolidated information in a serial format. Once the decoder 98 
has decoded the information and placed it in the serial format, then the row driver 100 
accounts for the serial information from each row and enables each row to be 
downloaded by the column or columns. In short, the latches 94 will initially allow the 
information stored in each pixel to be accessed. The counter 96 then controls the 

15 amount of information flow based upon a desired time sequence. Once the counter has 
reached its set point, the decoder 98 then knows to take the information and place it in 
the serial format. The whole process is repeated, based upon the timing sequence that is 
programmed. When the row driver 100 has accounted for each of the rows, the row 
driver reads out each of the rows at the desired video rate. 

20 The information released from the column or columns is also controlled by a 

series of latches 102, a counter 104 and a decoder 106. As with the information from 
the rows, the column information is also placed in a serial format which may then be sent 
to the video processing board 50. This serial format of column information is the pre- 
video signal carried by conductor 48. The column signal conditioner 108 places the 

25 column serial information in a manageable format in the form of desired voltage levels. 
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In other words, the column signal conditioner 108 only accepts desired voltages from the 
downloaded column(s). 

The clock input to the timing and control circuits 92 may simply be a quartz 
crystal timer. This clock input is divided into many other frequencies for use by the 

5 various counters. The run input to the timing and control circuit 92 may simply be an 
on/off control The default input can allow one to input the pre-video signal to a video 
processor board which may run at a frequency of other than 30 hertz. The data input 
controls functions such as zoom. At least for a CMOS type active pixel array which can 
be accessed in a random manner, features such as zoom are easily manipulated by 

10 addressing only those pixels which locate a desired area of interest by the user. 

A further discussion of the timing and control circuitry which may be used in 
conjunction with an active pixel array is disclosed in U.S. Patent No. 5,471,515 and is 
also described in an article entitled "Active Pixel Image Sensor Integrated With Readout 
Circuits" appearing in NASA Tech Briefs, October 1996, pp. 38 and 39. This particular 

15 article is also incorporated by reference. 

Once image sensor 40 has created the pre-video signal, it is sent to the video 
processing board 50 for further processing. At board 50, as shown in Figure 9b, the pre- 
video signal is passed through a series of filters. One common filter arrangement may 
include two low pass filters 1 14 and 1 16, and a band pass filter 1 12. The band pass filter 

20 only passes low frequency components of the signal. Once these low frequency 

components pass, they are then sent to detector 120 and white balance circuit 124, the 
white balance circuit distinguishing between the colors of red and blue. The white 
balance circuit helps the imaging device set its normal, which is white. The portion of 
the signal passing through low pass filter 1 14 then travels through gain control 118 

25 which reduces the magnitude or amplitude of this portion to a manageable level. The 
output from gain control 1 18 is then fed back to the white balance circuit 124. The 
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portion of the signal traveling through filter 1 16 is placed through the processor 122. In 
the processor 122, the portion of the signal carrying the luminance or non-chroma is 
separated and sent to the Y chroma mixer 132. Any chroma portion of the signal is held 
in processor 122. 

5 Referring to the output of the white balance circuit 124, this chroma portion of 

the signal is sent to a delay line 126 where the signal is then further reduced by switch 
128. The output of switch 128 is sent through a balanced modulator 130 and also to the 
Y chroma mixer 132 where the processed chroma portion of the signal is mixed with the 
processed non-chroma portion. Finally, the output from the Y chroma mixer 132 is sent 

10 to the NTSC/PAL encoder 134, commonly known in the art as a "composite" encoder. 
The composite frequencies are added to the signal leaving the Y chroma mixer 132 in 
encoder 134 to produce the post-video signal which may be accepted by a television. 
Additionally, the signal from Y chroma mixer 132 is sent to the digital signal processor 
72 so those images can be viewed on monitor 26. 

15 In addition to the functions described above that are achieved by the digital signal 

processor 72, the processor 72 can also provide additional digital enhancements. 
Specifically, digital enhancement can sharpen or otherwise clarify the edges of an image 
viewed on a video screen which might normally be somewhat distorted. Additionally, 
selected background or foreground images may be removed thus only leaving the desired 

20 group of images. 

In addition to digital enhancement, the digital signal processor 72 can include 
other circuitry that may further condition the signal received from board 50 so that it 
may be viewed in a desired format other than NTSC/PAL. One common encoder which 
can be used would be an RGB encoder. An RGB encoder separates the signal into the 

25 three primary colors (red, green and blue). A SVHS encoder (super video home system) 
encoder could also be added to processor 72. This type of encoder splits or separates 
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the luminance portion of the signal and the chroma portion of the signal. Some 
observers believe that a more clear signal is input to the video device by such a 
separation, which in turn results in a more clear video image viewed on the video device. 
Another example of an encoder which could be added to processor 72 includes a VGA 
5 compatible encoder, which enables the video signal to be viewed on a standard VGA 
monitor which is common to many computer monitors. 

One difference between the arrangement of image sensor 40 and the outputs 
found in Figure 3 of the Fossum, et al. patent is that in lieu of providing two analog 
outputs [namely, VS out (signal) and VR out (reset)], the reset function takes place in 
10 the timing and control circuitry 92. Accordingly, the pre-video signal only requires one 
conductor 48. 

Figures lOa-lOe illustrate in more detail one example of circuitry which may be 
used in the video processing board 50 in order to produce a post-video signal which may 
be directly accepted by a NTSC/PAL compatible video device such as a television. The 

15 circuitry disclosed in Figures lOa-lOe is very similar to circuitry that is found in a 

miniature quarter-inch Panasonic camera, Model KS-162. It will be understood by those 
skilled in the art that the particular arrangement of elements found in Figures lOa-lOe are 
only exemplary of the type of video processing circuitry which may be incorporated in 
order to take the pre-video signal and condition it to be received by a desired video 

20 device. 

As shown in Figure 10a, 5-volt power is provided along with a ground by 
conductors 44 and 46 to board 50. The pre-video signal carried by conductor 48 is 
buffered at buffer 137 and then is transferred to amplifying group 138. Amplifying 
group 138 amplifies the signal to a usable level as well as achieving impedance matching 
25 for the remaining circuitry. 
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The next major element is the automatic gain control 140 shown in Figure 10b. 
Automatic gain control 140 automatically controls the signal from amplifying group 138 
to an acceptable level and also adds other characteristics to the signal as discussed 
below. More specifically, automatic gain control 140 conditions the signal based upon 

5 inputs from a 12-channel digital to analog converter 141. Converter 141 retrieves stored 
information from EEPROM (electrically erasable programmable read only memory) 143. 
EEPROM 143 is a non-volatile memory element, which may store user information, for 
example, settings for color, tint, balance and the like. Thus, automatic gains controls 
140 changes the texture or visual characteristics based upon user inputs. Housing 24 

10 could also include buttons for controlling the image viewed on monitor 26 such as a gain 
control 140. The signal leaving the automatic gain control 140 is an analog signal until 
being converted by analog to digital converter 142. 

Digital signal processor 144 of Figure 10c further processes the converted signal 
into a serial type digital signal. One function of the microprocessor 146 is to control the 

15 manner in which digital signal processor 144 sorts the digital signals emanating from 
converter 142. Microprocessor 146 also controls analog to digital converter 142 in 
terms of when it is activated, when it accepts data, when to release data, and the rate at 
which data should be released. Microprocessor 146 may also control other functions of 
the imaging device such as white balance. The microprocessor 146 may selectively 

20 receive the information stored in the EEPROM 143 and carry out its various commands 
to further control the other elements within the circuitry. 

After the signal is processed by digital signal processor 144, the signal is sent to 
digital encoder 148 illustrated in Figure lOd. Some of the more important functions of 
digital encoder 148 are to encode the digital signal with synchronization, modulated 

25 chroma, blanking, horizontal drive, and the other components necessary so that the 
signal may be placed in a condition for reception by a video device such as a television 
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monitor. As also illustrated in Figure lOd, once the signal has passed through digital 
encoder 148, the signal is reconverted into an analog signal through digital to analog 
converter 150. 

This reconverted analog signal is then buffered at buffers 151 and then sent to 
5 amplifier group 152 of Figure lOe which amplifies the signal so that it is readily accepted 
by a desired video device. Specifically, as shown in Figure lOe, one SVHS outlet is 
provided at 160, and two composite or NTSC outlets are provided at 162 and 164, 
respectively. 

From the foregoing, it is apparent that an entire imaging device may be 
10 incorporated within the distal tip of the camera module, or may have some elements of 
the imaging device being placed in the housing of the PDA. Based upon the type of 
image sensor used, the profile area of the imaging device may be made small enough to 
be placed into a camera module which has a very small diameter. 

This invention has been described in detail with reference to particular 
15 embodiments thereof, but it will be understood that various other modifications can be 
effected within the spirit and scope of this invention. 



